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ABSTRACT 


>Ss,A  very  simple  and  flexible  procedure  is  given  for  reducing  a 
concave  mathematical  program  to  a  finite  sequence  of  subproblems,  each 
involving  a  subset  of  the  original  constraints.  While  very  much  in  the 
spirit  of  the  "secondary  constraint"  idea,  constraints  are  dropped  as  well 
as  added  from  subproblem  to  subproblem.  The  reduction  procedure  is  of 
quite  general  applicability,  and  is  designed  to  be  used  with  various 
concave  programming  algorithms  for  solving  the  subproblems.  It  seems 
particularly  suited  to  facilitating  the  solution  of  problems  with  more 
constraints  than  could  otherwise  be  handled.  It  is  shown  that  an  obvious 
specialization  to  linear  programs  yields  the  dual  Simplex  method,  and 
that  various  "cutting-plane"  methods  can  also  be  naturally  described  from 
the  general  viewpoint  offered  here.  1  '  /' 


DIRECT  REDUCTION  OF  LARGE  CONCAVE  PROGRAMS 


This  paper  discusses  an  extremely  simple  procedure  for  directly 
reducing  a  concave  mathematical  program  to  a  finite  sequence  of  sub  problems, 
each  with  a  subset  of  the  original  constraints.  Hie  procedure  Is  quite 
flexible  and  general  In  its  applicability.  It  is  intended  primarily  for 
use  with  various  concave  programming  algorithms  to  enable  them  to  solve 
problems  with  more  constraints  than  would  otherwise  be  possible;  hence  how 
to  solve  the  subproblems  is  deliberately  left  unspecified  here.  Hovever, 
its  use  is  by  no  means  restricted  to  large  problems. 

Although  conceived  in  the  spirit  of  related  reduction  procedures 
developed  by  the  author  [3,4]  for  concave  programs  with  some  linear  inequality 
constraints,  it  soon  became  evident  that  it  can  be  viewed  as  a  generalization 
of  the  "secondary  constraints"  procedure  discussed  by  Dantzig  [2]  for  linear 
programs;  which,  in  turn,  can  be  viewed  as  a  way  of  implementing  the  dual 
Simplex  method  [8].  Indeed,  we  shall  show  that  the  procedure  has  a  natural 
specialization  for  linear  programs  that  corresponds  exactly  to  the  dual 
Simplex  method.  We  further  show  that  various  "cutting-plane"  methods  can 
be  viewed  naturally  as  instances  of  the  reduction  procedure.  Some  of  its 
aspects  can  also  be  found  in  a  number  of  other  works  not  cited  here. 

In  section  I  we  present  the  procedure,  validate  it,  discuss  its  main 
arbitrary  feature,  and  indicate  its  relation  to  an  alternative  class  of 
reduction  procedures.  In  section  II  we  prove  that  it  can  be  naturally 
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specialized  to  the  dual  Simplex  method  when  applied  to  a  linear  program. 

Die  final  section  discusses  difficulties  that  arise  when  there  is  an  infinite 
number  of  constraints,  or  when  some  of  the  constraints  are  not  explicitly 
available.  Gomory's  method  for  integer  linear  programming  [5]  and  Kelley's 
method  for  concave  programming  [7]  are  shown  to  be  instances  of  the  reduction 
procedure  for  which  these  difficulties  can  be  at  least  partially  overcome. 
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I.  THE  REDUCTION  PROCEDURE 

Let  f,  g concave  functions  defined  on  a  convex  set 
XCRn,  and  let  M  be  a  finite  index  set  (e.g.,  M  *  (1,2, . .  .,m)). 

The  problem 

(P)  Maximize  Y  f(x)  subject  to  g.(x)  >0,  i  e  M 

will  be  reduced  to  a  finite  sequence  of  subproblems  of  the  form 

(Pa)  Maximize  „  v  f(x)  subject  to  g.(x)  >  0,  i  e  S  c  m. 

O  X  S  A  1  “  “ 

Assume  that  a  subset  S°  is  known  such  that  (Pg0)  admits  an  optimal 

gO  gO 

solution  x  (with  f(x  )  <  °°),  and  assume  further  that  (Pg)  admits  an 

optimal  solution  whenever  it  admits  a  feasible  solution  and  its  maximand 

go 

is  bounded  above  on  the  feasible  region  by  f(x  ). 

Under  the  above  assumptions,  we  shall  show  that  the  following  procedure 
is  well-defined  and  terminates  in  a  finite  number  of  steps. 

The  Reduction  Procedure 

Step  0:  Put  f  ■  00  and  S  »  S°,  where  S°  is  any  subset  of  M  such 
(pgo)  admits  a  finite  optimal  solution. 

s 

Step  1:  Solve  (P<,)  for  an  optimal  solution  x  if  one  exists;  if 
none  exists  (i.e.,  (Pg)  is  infeasible),  then  terminate  with 
the  message  "(P)  infeasible”.  Define  Vg  «■  (i  «  M-S;  g^(x®)  <  0). 
If  Vg  =  terminate  with  the  message  ”x^  is  an  optimal 

solution  of  (P)";  otherwise,  go  on  to  Step  2. 
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Step  2:  Put  v  equal  to  ai ./  subset  of  M  such  that  {v  fl  Vg )  ^ 

S  m 

If  f(x  )  <  f,  replace  S  by  Eg  U  v,  where  Eg  ■  {i  e  S: 
S  •  s 

«i(x  )  ■  0),  and  f  by  f(x  );  otherwise  (i.e.,  if 
f(x  )  *  f),  replace  S  by  S  U  v.  Return  to  Step  1. 


This  procedure  simply  goes  from  one  subproblem  to  the  next  by  adding 
at  least  one  constraint  that  is  violated  at  an  optimal  solution  of  the 
current  subproblem,  while  deleting  the  amply  satisfied  constraints  so  long 
as  the  value  of  the  objective  function  is  decreasing.  Eventually  a  sub¬ 
problem  is  encountered  that  is  either  infeasible,  in  which  case  (P) 
obviously  must  be  infeasible,  or  has  an  optimal  solution  that  is  also 
feasible  in  (P),  in  which  case  that  solution  obviously  must  solve  (P). 

To  show  that  the  subproblems  which  arise  are  either  infeasible  or  admit 
an  optimal  solution,  in  view  of  our  assumptions  it  is  enough  to  show 
inductively  that  the  sequence  <A>  is  non-increasing,  where  f®  is  the 

g 

supremum  of  the  maximand  of  (Pg)  (let  f  =  -®  if  (Pg)  is  infeasible). 
Certainly  f^7  <  fS,  and  <  f^3  .  We  assert  that  f^  =  f^,  which 

yields  the  desired  monotonicity  of  <f^.  The  assertion  is  an  easy  consequence 
of 


s  s 

Lemma  1.1:  Let  x  be  optimal  for  (P„).  Then  g,(x  )  >  0  and 
-  o  J 

g 

J  e  S  implies  that  x  is  also  optimal  for  (P0  ,). 

a-j 

Proof:  Certainly  r  ^  >  f(x^).  Suppose  that  f®"^  >  f(xS).  Then  there 

Q 

exists  a  point  x'  feasible  in  (Pg_j)  such  that  f(x')  >  f(x  ).  We  may 

g 

assume  g^(  x 1 )  <  0,  or  else  x1  would  contradict  the  optimality  of  x  in 
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(Pg).  By  the  concavity  of  f  and  the  g^  i  e  S,  and  the  convexity  of  X, 
it  follows  that  for  X  positive  but  sufficiently  small  the  point 
Xx’  +  (l-X)x^  is  feasible  in  (Pc).  But  then  fCXx’+Cl-Xjx^)  > 

o  “  -I 

Xf(x’)  +  (l-X)  f(xS)  >  f(xS),  which  contradicts  the  definition  of  xS. 

S  m  4  g  g 

Hence  f  f(x  ),  and  x  must  be  optimal  for  (Pe  4). 

D-J 

Thus  far  we  have  shown  that  the  procedure  is  well-defined,  and  that 

g 

the  sequence  <f(x  )>  is  non-increasing.  Since  Step  2  only  deletes  amply 
satisfied  constraints  from  S  (before  adding  v)  when  the  maximand  has  Just 
strictly  decreased,  it  follows  from  the  finiteness  of  the  number  of  possible 

g 

subsets  of  M  that  <f(x  )>  can  remain  constant  for  only  a  finite  number 
of  consecutive  iterations.  Again  appealing  to  the  finiteness  of  the 
number  of  possible  trial  sets,  we  see  that  finite  termination  is  established. 

Theorem  1.1:  The  reduction  procedure  terminates  in  a  finite  number 
of  steps  with  either  (a)  an  optimal  solution  of  (P),  or  (b)  the 
identification  of  a  subset  of  the  constraints  of  (P)  that  are  collec¬ 
tively  infeasible  over  X.  Moreover,  in  case  (a)  a  monotone  decreasing 

g 

sequence  <f(x  )>  of  upper  bounds  on  the  optimal  value  of  (P)  is 
obtained. 

Choice  of  v 

There  is  considerable  latitude  in  the  choice  of  v  at  Step  2.  lhe 
only  requirement  is  that  it  must  include  the  index  of  at  least  one  constraint 

g 

violated  by  the  current  x  .  As  will  be  discussed  more  fully  in  section  III, 
there  are  cases  in  which  it  is  difficult  or  expensive  to  identify  any 
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violated  constraint,  let  alone  all  of  Vg.  But  when  Vg  is  readily 

available,  propitious  choice  of  v  can  heighten  computational  efficiency.  ofi 

There  are  at  least  two  conflicting  considerations  in  the  choice  of 
v,  depending  on  whether  one  focuses  on  making  the  subproblems  easy  to  solve 
or  on  making  the  number  that  must  be  solved  small.  On  one  hand,  the  fewer 
the  indices  of  which  v  is  composed  t  -•  easier  it  will  probably  be  to 

g 

solve  the  next  subproblem  starting  from  the  current  x  .  When  a  "primal 
feasible"  optimization  method  is  used  to  solve  the  subproblems,  for  example, 

g 

it  can  be  applied  starting  with  the  last  x  to  each  gj,  J  e  v,  in  turn, 

until  a  feasible  solution  is  found  for  the  new  subproblem  (or  until  it  is  < 

determined  that  the  new  subproblem  is  infeasible).  A  reasonable  choice  of  ■ 

v  from  this  point  of  view  might  be  to  let  it  be  a  singleton  (the  index  of  i 

the  most  violated  constraint,  say).  On  the  other  hand,  it  would  seem  that  ( 

by  taking  v  large  (all  of  Vg  or  even  more)  the  number  of  subproblems  to  * 

be  solved  will  be  relatively  small.  This  point  of  view  is  suggested  by  ( 

s 

interpreting  the  reduction  procedure  as  minimizing  f(x  )  over  S  c  M; 

the  more  violated  constraints  are  imposed  at  each  iteration,  the  greater  c 

g 

will  be  the  decrease  of  f(x  )  at  next  subproblem.  The  compromise  between  h 

these  two  points  of  view  which  tends  to  minimize  total  computation  time  is 
probably  quite  problem-dependent. 

Relation  to  Another  Reduction  Procedure 

When  the  g.^  are  all  linear,  or  when  any  nonlinear  constraints  have 
been  incorporated  into  X,  we  have  shown  elsewhere  [3>^]  how  to  reduce  (P) 
to  a  sequence  of  subproblems  of  the  form 

(P')  Maximize  _  v  f(x)  subject  to  g.(x)  =0,  i  e  S  c  M. 

b  X  *  A  1  — 
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The  advantage  of  such  subproblems  is  clear:  linear  equality  constraints  are 
often  easier  to  deal  with  than  the  corresponding  inequality  constraints 
(especially  when  some  of  these  constraints  are  simple  non-negativity 
requirements).  Without  going  into  details,  we  can  indicate  that  this  sub¬ 
problem  simplicity  is  purchased  at  the  price  of  a  slightly  more  complicated 
reduction  strategy  and  proof  of  termination. 

One  variant  [V]  chooses  the  next  subproblem  from  the  current  one  by 
the  addition  or  deletion  of  a  single  constraint  according  to  random  selection 
from  a  certain  set  of  candidates.  It  is  interesting  to  note  that  Markov 
chain  analysis  and  computational  results  suggest  that  termination  then 
takes  place  on  the  average  in  something  less  than  2N  subproblems,  where  N 
is  the  number  of  mistakes  made  in  identifying  (by  the  choice  of  the  initial 
(P^))  the  truly  restrictive  constraints  of  (P).  Other  variants  coincide, 
when  (P)  is  a  linear  program,  with  the  primal  or  dual  Simplex  methods 
(cf.  the  next  section). 

Unfortunately  subproblems  of  the  form  (P^)  are  not  helpful  when  some 
of  the  g^  are  nonlinear,  for  then  the  feasible  region  need  no  longer 


be  convex. 
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II.  RELATION  TO  THE  UJAL  SIMPLEX  METHOD 

The  fact  that  a  feasible  solution  of  (P)  is  not  obtained  until  the 

g 

final  step,  and  that  <f(x  )>  is  monotone  decreasing  to  the  optimal  value 
of  (P),  suggests  the  adjective  "dual”  in  describing  the  reduction  procedure. 
Indeed,  in  this  section  we  shall  show  that  the  procedure  can  be  specialized 
in  a  natural  way  to  yield  Lemke's  dual  Simplex  method  [8]  when  (P)  is  a 
linear  program. 

Let  f(x)  =  cx, 

g^(x)  =  xi#  M  =  (1,  ...,n},  and  X  =  {x:Ax  =  b)  hold  for  (p),  where 
c  is  1  x  n,  b  is  m^  x  1,  and  A  is  x  n.  The  dual  Simplex  method 

is  initiated  with  some  set  B°  of  variables  designated  as  "basic"  which 
yields,  from  the  "reduced  costs"  of  an  associated  tabular  representation 
of  (P)  (  see  below),  a  feasible  solution  of  the  dual  to  (P).  Assuming  that 
the  successive  feasible  solutions  to  the  dual  are  non-degenerate,  we  shall 
prove 

Theorem  2.1:  If  S°  is  taken  as  M-B°  and  v  always  as  the  most 

i.1. 

violated  constraint,  then  the  set  of  non-basic  variables  at  the  u 

iteration  of  the  dual  Simplex  method  coincides  with  Eg  at  the  v 

til 

iteration  of  the  reduction  procedure,  and  the  v  basic  solution 

til  s 

coincides  with  the  v  x  . 

It  is  necessary  to  give  a  brief  rendering  of  the  dual  Simplex  method 
in  order  to  establish  the  notation  used  in  the  proof.  More  complete  details 
may  be  found,  for  example,  in  [6]  or  [8], 
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Problem  (P)  can  be  restated  as  one  of  maximizing  z  subject  to 
x  >  0  and  the  following  equality  constraints  stated  as  a  tableau 
(m^+1  by  n+2)  of  detached  coefficients: 


At  any  given  iteration  there  is  specified  a  collection  B  of  basic 
variables  such  that  A^  exists 
from  A  according  to  B,  and  such  that  c  =  (CgA^1)A  -  c  >  0,  where 
cB  is  similarly  formed  by  extraction  according  to  B.  Moreover,  the  equality 
constraints  are  re-expressed  as: 


,  where  A-,  is  formed  by  extracting  columns 


z  x  =  1 


1 

(cBAB  )a  ■  c 

1  CbV* 

0 

A^XA 

A^Lb 

If  b  =  A^1  b  >  0,  then  it  is  easily  shown  that  an  optimal  solution  of  (P) 
is  at  hand:  put  x^  =  0  for  j  non-basic  and  the  basic  variable  x^ 
corresponding  to  the  i  row  equal  to  i^.  If  b  ^  0,  then  let  br  be 
the  most  negative  component  (actually,  any  negative  component  will  do)  and 
test  to  make  sure  that  at  least  one  component  ar^  of  the  matrix  A^1  A 
is  negative  for  some  non-basic  J  (if  none  is  negative,  it  can  be  shown 
that  (P)  is  infeasible).  Let  k  be  defined  so  that 


—  =  Maximum 

a  , 
rk 


l-l 


a 


'rj 


j  non-basic  and  a  .  <  0  )  , 

rj  ' 
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and  pivot  on  the  element  to  obtain  the  detached  coefficient  array 

corresponding  to  the  new  set  of  basic  variables  {B  -  Bf  +  k)  (x^  is  called 

the  "entering,"  and  Xg  the  "exiting"  basic  variable).  If  c^  >  0  then 
-1  r 

CgAg  b  strictly  decreases,  and  in  any  event  the  new  c  is  also  non-negative, 

The  assumption  of  dual  non-degeneracy  means  that  c  >  0  for  all  non-basic 

J 

j  at  each  iteration,  and  can  always  be  enforced  by  arbitrarily  small 
perturbations  of  the  problem  data. 

We  are  now  in  a  position  to  make  three  key  observations  about  the 
duel.  Simplex  method. 


Lemma  2.1;  At  any  iteration  of  the  dual  Simplex  method,  the  current 
basic  solution  is  the  unique  optimal  solution  of  (Pg)  with  S  equal 
to  the  current  set  of  non-basic  variables  (S  =  M-B). 

Proof:  The  current  basic  solution  is  certainly  feasible  in  To 

show  that  it  is  optimal,  by  the  Dual  Theorem  of  linear  programming  it 
suffices  to  display  a  feasible  solution  to  the  dual  of  (P..  with  the 
same  value  of  the  objective  function.  One  has  only  to  verify,  using 

-  /  -In 

c  >  0,  that  (cgAg  )  is  such  a  dual  solution.  Uniqueness  of  the  optimal 
solution  of  follows  from  the  assumed  non-degeneracy  of  the  dual. 

Lemma  2.2:  If  the  dual  Simplex  method  terminates  because  (P)  is 

infeasible  (i.e.,  if  b  <0  and  a  .  >  0  for  all  non-basic  j 

r  rj  — 

at  some  tableau),  then  (Pg  ),  with  S  equal  to  the  current  set  of 
non-basic  variables  plus  B^,  is  infeasible. 
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Proof:  By  the  Dual  Theorem  of  linear  programming,  It  Is  enough  to  show 
that  the  dual  of  (Pg  )  is  feasible  and  has  an  unbounded  optimum.  It  may 
be  verified  that  (cgA^1)  +0(A^1)r#  >  where  (A^j1)^  is  the  row 

of  Ag  (bf  <  0),  is  feasible  in  the  dual  for  all  0  >  0  and  achieves 
an  arbitrarily  small  value  of  the  dual  objective  as  0  -»  ». 


Lemma  2.3:  At  any  non-terminal  iteration  of  the  dual  Simplex  method, 
if  is  the  entering  basic  variable  then  x^  >  0  in  the  next 


basic  solution. 


Proof:  The  definition  of  the  pivot  operation  implies  that  x^  =  (f>  /a^) 

in  the  next  basic  solution.  By  selection,  b  <  0  and  a  .  <  0. 

J  r  rk 


Proof  of  Th.  2.1:  The  proof  proceeds  by  induction  on  v.  At  v  =  1, 

S°  has  been  taken  as  M-B°,  the  initial  set  of  non-basic  variables. 

SO  s° 

Lemma  2.1  asserts  that  (Pg0)  has  a  unique  solution  x  .  Hence  x  must 

go 

be  the  initial  basic  solution.  Since  x^  =  0  by  definition  for  all  non- 

basic  j,  Ego  =  S°.  Thus  the  assertion  is  true  for  v  =  1. 

Assume  that  the  assertion  is  true  for  the  iteration  of  the  dual 

o 

*fcll 

Simplex  method.  Either  the  iteration  is  terminal  because  (P)  has 

been  solved,  or  is  terminal  because  (P)  has  been  found  to  be  infeasible,  or 
is  not  terminal.  In  the  first  case,  the  reduction  procedure  also  termi¬ 
nates  with  an  optimal  solution  of  (P).  In  the  second  case,  by  Lemma  2.2 
the  next  sub-problem  encountered  by  the  reduction  procedure  is  infeasible 
and  therefore  terminal.  Consider  now  the  third  case.  We  shall  show  that 
the  assertion  of  the  theorem  1  'ds  at  the  next  iteration  by  detailing  the 
operation  of  the  reduction  procedure  starting  at  Step  2  of  the  current 


iteration. 
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\  s 

Dual  non-degeneracy  Implies  that  f(x  )  decreases  strictly  at 

each  lterat^OnT  - the  trial  set  to  he  used  at  the  (uQ+l)st 

iteration  of  the  reduction  procedure  is  Eg  U  Bf,  where  Is  the 

S  ^ 

most  negative  component  of  the  current  x  .  It  follows  from  Lemmas  2.1 

and  2.3  that  (P„  (jn  )  has  a  unique  solution,  and  that  all  components 

or 

indexed  by  EgUB^  vanish  in  this  solution  except  for  x^,  which  is  strictly 
positive.  The  assertion  of  the  theorem  now  follows  immediately. 

It  would  not  be  at  all  surprising  if  a  similar  relation  to  van  de  Panne 
and  Whinston's  dual  method  for  quadratic  programming  [9]  could  be  established, 
in  view  of  its  close  relation  to  the  dual  Simplex  method. 
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III.  DISCUSSION 

There  are  two  especially  important  types  of  difficulties  that  may 
arise  in  connection  with  certain  potential  applications  of  the  reduction 
procedure.  One  is  that  there  may  he  an  infinite  (possibly  uncountable) 
number  of  constraints  associated  with  (P).  In  this  case  most  of  the 
constraints  can  be  expected  to  be  redundant,  and  the  number  of  constraints 
in  the  subproblems  will  usually  not  become  unbounded.  It  may  or  may  not 
be  difficult  to  test  for  Vg  =  (  at  Step  1,  and  a  convergence  proof  must 
be  constructed  along  different  lines  than  the  one  given  above.  The  other 
difficulty  is  that  some  or  all  of  the  constraints  may  only  be  implicitly 
available,  or  available  only  at  high  computational  cost.  This,  of  course, 
may  make  it  difficult  to  identify  any  violated  constraint,  let  alone  an 
advantageous  subset  of  Vg. 

One  or  both  of  these  difficulties  are  encountered  by  the  so-called 
"cutting-plane"  methods  of  mathematical  programming,  as  typified  by 
Gomory's  method  for  integer  linear  programming  [5]  and  Kelley's  method  for 
concave  programming  [?]•  The  term  "plane"  rather  than  "surface"  has  come 
into  general  use  because  such  methods  usually  employ  linear  rather  than 
nonlinear  constraints. 

Gomory's  method  can  be  viewed  as  the  dual  Simplex  method  applied  to 
a  linear  program  that  is  equivalent  to  the  original  integer  program; 
equivalent  in  the  sense  that  its  feasible  region  coincides  with  the  convex 
hull  of  the  feasible  Integer  solutions  of  the  original  program.  Although 
there  is  a  vast  number  of  constraints,  and  most  of  them  are  not  explicitly 
available,  Gomory  has  shown  how  to  generate  an  appropriate  violated  constraint 
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inexpensively  if  Vg  ^  ^  (in  our  terminology).  This  enables  Step  2  to 
be  carried  out,  and  of  course  there  is  no  difficulty  in  testing  Vg  ■  </>, 
Convergence  is  finite,  although  "finite"  is  sometimes  too  large  for 
practical  purposes. 

Kelley's  method  (see  also  Cheney  and  Goldstein  [l],  and  the  references 
therein)  can  be  cast  in  the  form  of  the  present  reduction  procedure 

as  follows.  Define  G(x)  =  Min  (g. (x)). 

i  1 

(G(x)  is  concave  on  X.)  Then  (P)  can  be  replaced  by 

MaximizexgX  f(x)  subject  to  G(x)  >  0. 

Kelley  imposes  sufficient  conditions  for  the  existence  of  a  support 
G(x')  +  Y  ,.(x-x')  to  the  graph  of  G  for  each  x'  in  X,  where  Y  ,  is 
a  fixed  n-vector  for  each  x'  e  X.  For  fixed  x',  the  support  function 
is  linear  and  has  the  defining  property:  G(x')  +  y  ,*(x-x')  >  G(x)  for 
all  x  e  X,  with  equality  holding  for  x  ■  x'.  (If  G  is  differentiable  at 
x',  y  ,  is  Just  the  gradient  of  G  at  x'.)  The  family  of  support 
functions  for  G  is  introduced  to  permit  the  feasible  region  of  (P)  to 
be  represented  by  the  intersection  of  the  half -spaces  containing  it; 
that  is,  to  enable  (P)  to  be  replaced  by 

Maximize  f(x)  subject  to  g(x’)  +  V  , ’(x-x1)  >  0,  all  x'eX', 
xeX  X 

where  X'  *  {x'«X:G(x')  <  0).  It  is  easy  to  verify  that  this  problem, 
which  in  addition  to  X  is  restricted  by  an  infinite  collection  of  linear 
constraints  indexed  by  X',  has  the  same  feasible  region  as  (P).  Now  apply 
the  reduction  procedure.  Testing  for  Vg  ■  f  is  equivalent,  of  course, 
to  testing  G(x  )  >  0.  (Since  this  test  is  unlikely  ever  to  be  satisfied 
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for  truly  nonlinear  problems,  in  practice  one  would  probably  test 

s 

G(x  )  >  -€,  where  6  is  some  suitably  small  positive  number.)  If 
S°  a  0  and  v  is  chosen  to  correspond  to  the  constraint 
G(xS)  +  Y^six-y?)  >  0 

at  Step  2,  then  the  result  is  Kelley’s  method  with  an  explicit  rule  for 
dropping  unneeded  constraints  (cf.  [7,p.  710]).  Note  that  the  choice  of 
v  is  not  necessarily  the  constraint  most  violated  at  the  current  trial 
solution;  but  it  is  violated,  and  it  would  be  computationally  expensive 
to  find  one  that  is  more  so.  Of  course,  since  M  (=  X'  here)  is  infinite 
our  finite  termination  proof  no  longer  holds.  But  Kelley  was  able  to  obtain 
a  simple  proof  of  convergence  in  the  limit  (cf.  [l])  under  rather  mild 
conditions,  and  this  suggests  that  convergence  of  the  reduction  procedure 
in  the  appropriate  sense  can  also  be  shown  for  other  interesting  classes 
of  problems  with  an  infinite  number  of  constraints. 
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